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Abstract 

Pontryagin's Maximum Principle is an outstanding result for solving optimal control problems 
by means of optimizing a specific function on some particular variables, the so called controls. 
However, this is not always enough for solving all these problems. A high order maximum 
principle (Krener, 1977) must be used in order to obtain more necessary conditions for optimality. 
These new conditions determine candidates to be optimal controls for a wider range of optimal 
control problems. 

Here, we focus on control-affine systems. Kroner's high order perturbations are redefined 
following the notions introduced in Aguilar-Lewis (2008). A weaker version of Krener's high 
order maximum principle is stated in the framework of presymplectic geometry. As a result, 
the presymplectic constraint algorithm in the sense of Gotay-Nester-Hinds (1979) can be used. 
We establish the connections between the presymplectic constraint algorithm and the candidates 
to be optimal curves obtained from the necessary conditions in Krener's high order maximum 
principle. In this paper we obtain weaker geometric necessary conditions for optimality of ab- 
normal solutions than the ones in Krener (1977) and the ones in the weak high order maximum 
principle. These new necessary conditions are more useful, computationally speaking, for finding 
curves candidate to be optimal. The theory is supported by describing specifically some of the 
above-mentioned conditions for some mechanical control systems. 

Keywords: Optimal control problem, high order perturbations, presymplectic constraint 
algorithm. 
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1 Introduction 

Pontryagin's Maximum Principle (PMP) [18] is a useful result to try to solve optimal control prob- 
lems since it provides necessary conditions for optimality. This Principle is understood as a first 
order test of optimality for two reasons. If the controls take values in the interior of the control 
set, the condition of maximization of the Hamiltonian can be replaced by the fact that the partial 
derivative of the Hamiltonian with respect to the controls vanishes. On the other hand, the per- 
turbations of the optimal curves at a point are linearly approximated by the so-called perturbation 
vectors in a neighbourhood of the point. 

Despite the utility of Pontryagin's Maximum Principle it is not always possible to determine the 
optimal controls from its necessary conditions [8j [15] . For instance, the singular optimal curves are 
those curves whose controls are not uniquely determined from the condition of maximization of the 
Hamiltonian [51 [15]. There are also the so-called abnormal extremals that cannot be determined in 
general by means of Pontryagin's Maximum Principle [8j[T7]. That is why research toward a high 



order maximum principle started to be developed [5j \13\ [T^l I15j . Hermes [12] was one of the first 
to introduce high order perturbations to study controllability along a fixed trajectory. Later these 
perturbations were adapted to provide necessary conditions for optimality [14\ [15] . 

Geometrically speaking, optimal control problems can be studied from the viewpoint of symplec- 
tic geometry or of presymplectic one. The former consists of fixing the controls in such a way that 
the natural symplectic structure of the cotangent bundle of the state space is considered [TJ [3l |21] . 
The latter consists of using the presymplectic structure [I] of the above cotangent bundle times 
the control set. In the presymplectic formalism, we are able to state a weaker version of Krener's 
high order maximum principle in the same way as stated the weaker version of Pontryagin's Max- 
imum Principle in [3]. Some of the necessary conditions for optimality coming from the weak high 
order maximum principle give a geometric meaning to previous techniques used in the literature 

nana nsj. 

The paper is organized as follows. In Section[2]we review the notion of an optimal control problem 
using two equivalent statements. Section [3] contains all the necessary elements to state Krener's high 
order Maximum Principle [TS] for control-affine systems by using the constructions in [2] . In Section 
13.11 a weak high order maximum principle is stated. The main result of this paper consists of 
establishing a connection between the above-mentioned weak principle and the classical high order 
maximum principle |15j as described in Sections 13.21 and 13.31 under the assumption of having an 
abnormal optimal solution. In order to clarify ideas, we conclude with a detailed description of 
some elements that appear in Section f3. 21 for some mechanical control systems in Section f3.3l 

Before concluding this introduction we want to point out that most of the theory in the first 
part of Section [3] and Section 13.11 can be rewritten for any control system. We restrict ourselves to 
control-affine systems because the aim of this paper is to establish a relationship between the above- 
mentioned presymplectic constraint algorithm and the high order maximum principle as explained 
in Section f3.2l for abnormal optimal solutions. This relationship is obtained by identifying brackets 
of vector fields in the control system with high order perturbation vectors. To our best knowledge, 
it is not known how to deal with that when the control systems are not control-affine. 

2 Background in optimal control theory 

First, let us define geometrically the notion of control system. 

Definition 1. Let M be an m- dimensional manifold and U be a subset o/M fc . A control system 
on M is a smooth vector field X defined along the projection ir: M x U — > M . A trajectory or 
an integral curve of the control system X is a curve (7, u) : I C M — > M X U such that 7 is 
absolutely continuous, u is measurable and bounded, and ^(t) = X(7(i),«(i)) a.e. for t 6 /. 

The set of control systems is denoted by 3L(tt); that is, the set of smooth vector fields defined 
along the projection ir. The curve u: I U is called the control. 

Given a control system X € X(7r) , we are usually interested in the set of points that can be 
reached from an initial point through trajectories (7, u) : / C IR — > M x U of X, where / = [a, b). In 
this regard, the following definition is essential. 

Definition 2. Let M be a manifold, U be a set in W k and X be a smooth vector field along the 
projection ir: M x U — > M. The reachable set from xq £ M at time T G / is the set of points 
described by 

TZ(xq,T) = {x 6 M there exists (7, u) : [a, b] — > M x U such that 

7(i) = X(>y(t), u{t)) a.e., 7(a) = x , -y{T) = x} . 



2 



The reachable set from a point xq € M up to time T is 



U(x ,<T)= |J K(x ,t). 



a<t<T 



The topological properties of the reachable set are closely related to different properties of the 
control system such as reachability, controllability, see [7j for more details. Moreover, in the sequel 
we briefly describe why the linear approximation of the reachable sets is the key point to prove 
Pontryagin's Maximum Principle [18] and also Krener's high order maximum principle |15j . 

2.1 Optimal control problem 

Let us define an optimal control problem associated to the control system in Definition [TJ Given 
T : M x U — >■ K, consider the functional 



defined on curves (7,?/) with a compact interval as domain. The function T: M x U — 1R is 
continuous on M x U and continuously differentiable with respect to M on M x U. 

If we fix the control u, the vector field X € can be rewritten as a time-dependent vector 

field lW : I x M TM, X^(t,x) = X(x,u{t)). 

Statement 3. (Optimal Control Problem, OCP) Given the elements M, U, X, J 7 , I = [a, b] 

and the endpoint conditions x a , Xf, € M, consider the following problem. 

Find (7, u) such that 

(1) 7(0) = x a , 7(6) = Xb (endpoint conditions), 

(2) 7 is an integral curve of X^ , i. e. j(t) = X^ (t,^f(t)), for a.e. t € /, and 

(3) 5[7, u] is minimum over all curves satisfying (1) and (2) (minimal condition). 

The function T is called the cost function of the problem. A solution to the OCP is a curve (7, u) 
satisfying conditions (l)-(3) in Problem [3] such that 7 is absolutely continuous and u is measurable 
and bounded. These problems are also known in the literature as Lagrange problems. 

2.2 Extended optimal control problem 

A usual technique in optimal control theory is to consider an equivalent problem to Problem [HJ but 
defined on the extended manifold M = R x M. Let X be the following vector field defined along 
the projection 7?: M x U -¥ M, 



where x is the natural coordinate on R. In this new manifold it is easier to identify the direction 
of decreasing of the cost function. Now the integral curves of the control system X are curves 
(7,11) = ((x° 07, 7), u): I —> M X U such that 7 is absolutely continuous and u is measurable and 
bounded. 

Statement 4. (Extended Optimal Control Problem, OCP) Given the elements in Problem 
[3l M and X, consider the following problem. 

Find (7, u) = (7°,7,ii) such that 




X(x , x, u) 



J r {x,u)d/dx \ {x o tX<u) +X{x,u) 
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(1) 7( a ) = (0, x a ), 7(6) = Xb (endpoint conditions), 

(2) 7 is an integral curve of X^ u \ i.e. j(t) = X^(t,j(t)), for a.e. t G I, and 

(3) 7°(6) is minimum over all curves satisfying (1) and (2) (minimal condition). 

A solution to the OCP is a curve (7, u) satisfying conditions (l)-(3) in Problem [5] such that 7 
is absolutely continuous and u is measurable and bounded. In the literature this problem is also 
known as Mayer problem. 

3 High order Maximum Principle for control-affine systems 

First order necessary conditions for optimality do not always provide enough information for finding 
the optimal solution. High order variations of a curve depending on parameters must be studied, as 
is done for instance in [51 [6j [TUl [13"1 [T4"l 1 15 j . in order to obtain high order necessary conditions for 
optimality. 

Given a fixed reference trajectory (7, u) defined in I C R, we use the description of high order 
variations for control-affine systems considered in [2] to study controllability at a point xq G M in 
order to obtain the variations along a reference trajectory defined in [15] . 

Let £ = (M, {Xq,X\, . . . , Xk}, U) be a control-affine system whose trajectories (7, u) on M x U 
satisfy 

k 

7(i) = Xo(7(i)) + E^(7(*))- 

c=l 

The vector field Xq is usually called the drift vector field and X\,... , X^. are the control or input 
vector fields. For the sake of simplicity all the vector fields are assumed to be complete from now 
on. 

Definition 5. Let £ = (£1, ■ ■ ■ , £r) be a finite sequence of vector fields on M where £i(x) G {Xq(x) + 
Ylc=l uC X c {x) I u G U} for each i G {1, . . . , r} and x S M. 

(i) The flow associated with £ called £-flow is the map : W x M — > M given by 

&(t,x)= ($£o...o (1) 

where t = (t±, . . . ,t r ). For a fixed x 6 M define W -> M by $|(t) = #(t,x), and /or a 
fixed t £W define <&\: M ^ M by $[(x) = $ 5 (t, x). 

(ii) A positive r-end-time variation is a smooth map r : [0, 00) — > M> wii/i i/ie property r(0) = 
0. T/ie sei of all the positive r-end-time variation is denoted by ET^!". 

As mentioned, the variations in Definition [5] are useful for studying particular notions of control- 
lability as shown in [2]. However, to study optimality the variations described in [15] are necessary. 
We describe them similarly to the ones in Definition [5] using some usual notation from the theory 
of jet bundles [19]. 

Definition 6. Let (7, u) be a reference trajectory associated with the vector field £0 an d £ = 
(£1, . . . , £ r ) be a finite sequence of vector fields on M where £i(x) € {Xq(x) + X^c=i ^X^x) \ u £ U} 
for each i G {0, . . . , r}, x G M, r G ET+ . 

(i) A (r + 2)-end-time variation is a smooth map T2 : [0, 00) — > M 2 x M> smc/i t/iai T2(s) = 
(51(a), ?2(s),r(s)) an(ir 2 (0) = 0. 
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(ii) The (^,T2) -variation along 7 at time to is the curve v^. T2 '■ [0;°°) ~~ > M given by 



. 0$*, v o 
9S («) r(a) 



*S W )(7(<0))- 



(2) 



(mj 7f T2 is (r + 2)-end-time variation, the order of the pair (£, T2) at 7(to) £ denoted 
ord 7 ( to )(^, T2), is t/ie smallest positive integer I such that there exists e > satisfying 



< e. 



(3) 



// no such s exists then the order is set to 00. 
(iv) //ord 7 ( to )(£,T2) = I, then the (£,T2) -infinitesimal variation at 7(to) is t/ie tangent vector 

^,t 2 =jW 2 )(o). 

^4 (£,72) -infinitesimal variation of order I is also called a high order elementary pertur- 
bation vector at 7 (to) °f order I. 

Note that the notion of order is defined by a condition that must be satisfied in a neighborhood 
of 0, see ([3]). As the controls are assumed to be measurable, this condition is necessary to guarantee 
that perturbations at different times can be summed as explained in [15j . 

These infinitesimal variations include the elementary perturbation vectors in the classical Pon- 
tryagin's Maximum Principle [TS]. They are defined as follows. Take £ = (£1) such that £i(x) = 



x o(x) + J2c=i u i X c(x) being u\ € U, r(s) = l x s for h £ R + , q 1 (s) = ~hs, q 2 (s) = 0. Then the 
(£j T2)-variation along 7 corresponding with £o(x) = Xq(x) + Ylc=i nC ^c(2 ; ) at time to is 

^(*) = (4>*-U(^o))- 
The (£, T2)-infinitesimal variation is given by 



_d 
ds" 



^,r 2 (s) = 



s=0 



+ 



ds 



^(T(s),^°(gi(s),7(to))) 



dx l 



(r( S ),* & (?iW.7(*d))) 



s=0 



ds 



s=0 



* & ) (9i(s),7(*o)) 



*i£i(7(*o)) + 



5x* 



(0,^( gi (s), 7 (to)))^(7(io))(-/i 



^(6(7(to)) -6(7(to))) = -u c (t ))X c ( 7 (t )), 



(4) 



c=l 



because $q X is the identity map. The last equality in ([U is exactly Pontryagin's elementary pertur- 
bation vectors for control- affine systems. 

Remark 7. All the theory developed in this section so far is true for general control systems apart 
from the last equality in only true for control-afnne systems. 

Definition 8. Let (7, it) be a reference trajectory associated with £0, to € I. The set of all the 
high order elementary perturbation vectors at 7 (to) of order I is 

*g a (7(to)) = {^ T2 GT 7{t0) M|T 2 eC oo (M,lR 2 )x^+,ord 7(t0) (£,T 2 ) = /, 

e = (6, • • .,&•), & e {ATj + Ec=i « c ^ c I « e [/} 

for each i = 1, . . . , r, r£ Z>i} . 
TTie set 0/ aZZ t/ie order elementary perturbation vectors at 7 (to) is 

^ 2 (7(io)) = U^ 2 (7(*o))- 
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Remark 9. If the control system is control- affine and € int U then Q guarantees that 



cone(conv{X 1 ( 7 (t)), . . . ,X fc ( 7 (i))}) C ^,( 7 (t)), 
where conv denotes convex hull. 

Proposition 10. The set / ^s 2 (7(*)) * s a convex cone. 

Proof. The set % 2 (t(*)) * s a convex cone if it is closed under addition and closed under M>o- 
multiplication. 

Then |15|. Lemma 3.1] guarantees that the order of any variation can be shifted upward and [15} 
Lemma 3.4] assures that the sum of variations of different order is a variation of higher order. Thus 
^£2(7^)) i s closed under addition. To prove that ^s 2 (7(i)) is closed under M>o-multiplication, the 
time must be re-scaled by using a different (r + 2)-end-time variation. ■ 

Definition 11. Let (7,11) be a reference trajectory associated with t € I. The high order 
tangent perturbation cone K% at j(t) is the smallest closed convex cone in T^mM that contains 
all the displacements by the flow of £0 of all the (£, T2) -infinitesimal variations along 7 at all Lebesgue 
times smaller than t, i.e., 



( \ 



Kf = conv 



U (4°_ to) )*oM7(*o))) 

a<t <t 

\to is a Lebesgue time ) 



(5) 



Remark 12. The notion of Lebesgue time comes from considering Caratheodory vector fields, see 
for instance [9] for more details. 

This cone generalizes the notion of tangent perturbation cone introduced in Pontryagin's Max- 
imum Principle [TJ [31 HE] so as to state and prove the high order maximum principle, see Theorem 
ED 



The high order tangent pertubation cone may be understood as an approximation of the reach- 
able set along a reference trajectory that is perturbed as shown in the following result. 

Proposition 13. Let (7,11) be a reference trajectory and t 6 (a, b). If v is a nonzero vector in the 
interior of the high order tangent perturbation cone Kt, then there exist e > and a (£, T2) -variation 
of order I such that 

^,r 2 (s) = 7 (<) + v— + o(s l ) for < s < e. 

Proof. It is part of the proof of Theorem 3.6 in |15|. page 266 ]. ■ 

We have constructed the above perturbations on the manifold M for the sake of simplicity, but 
in order to state the high order maximum principle these perturbations must be considered for the 
extended control system defined on M = K x M. On M the perturbations are defined analogously 
as the ones in Definition [6l Note that in general a control-affine system on M is not control-affine 
on M. However, as mentioned in Remark [TJ all the above constructions and results are true for any 
control system apart from Remark [9j 

To solve optimal control problems is difficult. That is why Pontryagin's Maximum Principle [18] 
transforms them into Hamiltonian problems that provide more conditions to characterize optimality. 
To state Krener's maximum principle [15] we need to define a Hamiltonian system associated with the 
control system X. First, consider the cotangent bundle T*M with its natural symplectic structure 
that will be denoted by If (x,p) = (x°,x,po,p) = (a; , a; 1 , . . . ,x m ,po,pi, . . . ,p m ) are local natural 
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coordinates on T*M, the form O has as local expression Q = dx° A dpo + dx l A dp^. For each u € U, 
H u : T*M —7- M is the Hamiltonian function defined by 



H u {p) = H(p, u) = (p, X(x, u)) = p F(x, u) + ^PiP{x, ■ 

i=l 

where p E TIM and X = Td/dx° + fdjdx 1 . The tuple (T*M,Q,H U ) is a Hamiltonian system. 

The assoi 
equation 



The associated Hamiltonian vector field Xjj on T*M defined by X^ (p) = Xh(p,u) satisfies the 



i 9M n = dH u . 



It should be noted that X^ = (x^\ ; that is, Xj^ is the cotangent lift of X^. Hence we get 
a family of Hamiltonian systems parameterized by u and given by H u . 

With the above constructions, the Hamiltonian system in mind and the following definition, we 
are able to state the high order maximum principle |15j . 



Definition 14. Let C be a cone with vertex at € T X M. A supporting hyperplane to C at is 

a hyperplane such that C is contained in one of the half-spaces defined by the hyperplane. 

Theorem 15. (High order maximum principle, HOMP) Let (7, u) : / — > M x U be a solution 
to OCP, Problem^ and let H be the Hamiltonian function defined by 

H:T*MxU — ► R ^ 
(p,u) 1 — ► H(p,u) = (p,X(x,u)) 

where p € TXM. Then there exists A: I — > T*M along 7 such that: 

(i) X is an integral curve of a Hamiltonian vector field X^ on T*M, i.e. solution to Hamilton's 
equations 

i ?W = dffW; (7) 

H 

(ii) (a) H(\(t),u(tj] — sup^gj/ H (A(t) , w) almost everywhere; 

(b) sup weU H(X(t), w) is constant everywhere; 

(c) for every t £ L, ker X(t) is a supporting hyperplane to Kt at 0; 

(d) A(t) ^ € TZ, t) M for each t G [a, b]; 

(e) Ao is constant and Ao < 0. 

Proof. It follows similarly to the proof of Pontryagin's Maximum Principle [Tj [3j [18] having in mind 
Proposition [T3J. For more details see proof in [151 Section 3] . ■ 

The condition that does not appear in the classical Pontryagin's Maximum Principle (PMP) is 
item (2c). The existence of this supporting hyperplane is not explicitly stated in PMP, though it 
is also fulfilled. Thus all the constructions related with the cones are not necessary to state the 
classical PMP, but they are completely necessary to prove it. After Definition [6] we have already 
proved how to relate (£, T2)- variations of order 1 with the elementary perturbation vectors used in 
the classical PMP, see For these vectors the existence of a supporting hyperplane is equivalent 
to 

(p, x(j{t), w(t)) - x(^(t),u(t))) < Vto s.t. w(t) eu, vt ei, 

that is, (p, X(j(t),w(t))} < (p, A > (7(t),u(i))) V w s.t. w(t) 6 U, V t G I. 



7 



In other words, the existence of a supporting hyperplane to the first order tangent perturbation cone 
is equivalent to the classical condition of maximization in PMP corresponding with (2a) in Theorem 
[T51 That is why in PMP the supporting hyperplane is not mentioned in the statement. 

On the contrary, in the high order version of this Principle more perturbations are considered. 
The usual necessary conditions in PMP appear in Theorem [T5| but also some extra conditions as 
given in (2c). These extra conditions consist of determining a hyperplane that supports a greater 
cone than the first order tangent perturbation cone. Remember that the need of a high order 
maximum principle comes from the need to obtain more conditions to determine the optimal controls. 

Observe that HOMP guarantees the existence of a covector along the optimal curve, but it does 
not say anything about the uniqueness of the covector, see Definition [T7] for the different kind of 
curves. Indeed, the key point in the proof of HOMP [15] consists of choosing an initial condition for 
A to integrate (|7J) in such a way that the resulting momentum satisfies all the necessary conditions 
in Theorem [TSJ Moreover, as 7 is an optimal trajectory, the momentum must separate the cone K± 
and the direction of decreasing of the cost function. Note that not all the supporting hyperplanes 
fulfill necessarily this separating condition. The non existence of a supporting hyperplane being also 
separating would immediately contradict the hypothesis of optimality, see proof in [TJ El \15\ \18\ for 
more details. 

Remark 16. We always refer to the maximum instead of supremum because the set of necessary 
conditions in HOMP guarantee that the supremum is achieved, so it can be called maximum. 

Definition 17. A curve (7, u): [a,b] — > M x U forOCP, Problem^ is 

(i) an extremal if there exists A: [a, b] — > T*M along 7 = ir^ o A being 7r^: T*M — > M and 
(A, u) : [a, b] — > T*M x U satisfies the necessary conditions of HOMP. The pair (A, u) is called 
biextremal for OCP; 

(ii) a normal extremal if it is an extremal with Ao = — 1; 
(Hi) an abnormal extremal if it is an extremal with Ao = 0; 

(iv) a strictly abnormal extremal if it is not a normal extremal, but it is abnormal. 



3.1 Weak high order maximum principle 

From now on the control set U is assumed to be an open set. In the sequel, we use a presymplectic 
framework to state a weaker high order Maximum Principle, as was already considered for PMP in 
[3] . We will show that the presymplectic framework provides some useful techniques to characterize 
optimality in a geometric way. Some of the new conditions obtained are easier to deal with than to 
compute the (£, T2)-infinitesimal variations in order to find a supporting hyperplane to all of them. 

Observe that [T*M x U, f2, H) is a presymplectic Hamiltonian system with being the pullback 
of the canonical 2-form on T*M through 717 : T*M x U — > T*M and H the function in ([6]). 

Theorem 18. (Weak high order maximum principle, WHOMP) Let (7, u) : I — > M x U be 

a solution to OCP, Problem and let H be the Hamiltonian function defined in |2|). Then there 
exists A : / — > T*M along 7 such that: 

(i) (A,n) is an integral curve of a Hamiltonian vector field Xh such that 

i$ H n = dH, i.e. *£ (t))6(t)) n = dH(X(t), u(t)); (8) 

(ii) (a) H(X(t),u(t)) is constant almost everywhere; 
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(b) for every t E I, ker \(t) is a supporting hyperplane to Kt at 0; 

(c) A(t) ^0e T* /or each t G [a, &]; 

(d) Ao is constant and Ao < 0. 

As Q is degenerate, ([8]) does not necessarily have solution on the entire manifold T*M x U. 
It may have a solution, see [11], if we restrict the equation to the primary constraint submanifold 
defined by 

N = {(A,u) GT*M x U \ i v dH = 0, for v G ker n@ )U) } • 

f ^ ^ ^ 

Locally, = -j (A, u) G T*M x U j ^(A, u) = 0, c = 1, . . . , k If Xo is a solution to the presym- 

plectic equation, then X N ° = Xq + ker Q. At this point, a presymplectic constraint algorithm in 
the sense given in [TT] starts. The stabilization process gives inductively Aq = {(A,u) G Nq | 3 X G 
I^ , X(A,ii) G ,iVo}, iV 2 , . . . N r such that iV r C iV r _i and finishes when A* = Aj_i for some 
i € N. The algorithm just imposes tangency conditions in order to find a submanifold where the op- 
timal trajectories live and stay. This algorithm has been adapted when the sets are not submanifolds 
[16j . thus this method is not that restrictive. 

Observe that Ao is defined implicitly by a necessary condition for the Hamiltonian to have an 
extremum over the controls as long as U is an open set. In Theorem 1151 the Hamiltonian is equal to 
the maximum of the Hamiltonian over the controls. Therefore, Theorem 1181 is just a weaker version 
of Theorem [15] and the proof is straightforward from Theorem [15] and the explanation given about 
the presymplectic constraint algorithm. 

For normal extremals, po = —1, and for cost functions quadratic on the controls, the presym- 
plectic algorithm stops at A^o- There the controls can already be determined. More discussion about 
how the algorithm behaves for abnormality is developed in the following section. 



3.2 Tangent perturbation cone versus presymplectic constraint algorithm 

The high order tangent perturbation cone in Definition [11] gives directions that approximate the 
perturbations of the optimal trajectory in the sense given in Proposition [13] On the other hand, 
the submanifolds that appear in the presymplectic constraint algorithm live in T*M x U and they 
are the zero sets of a family of vector fields Zj : M x U — > TM, j G N as is proved in the sequel. 

Our goal now is to establish a relationship between Kt and the sequence of constraint subman- 
ifolds Ni. From now on, we focus on abnormal optimal solutions because in general the normal 
optimal solutions admit a lift to the cotangent bundle T*M that lies in the primary constraint 
submanifold and so the algorithm stops in the first step. For abnormal extremals, the existence of 
a supporting hyperplane ker A to Kt is equivalent to the existence of a supporting hyperplane given 
by ker A to Kt without considering the extended manifold. 

Theorem 19. Let U be an open set in R fc , £ = (M, {Xq, . . . ,Xk}, U) be a control- affine system 
such that G int U and (7, u) be an abnormal optimal solution associated with £o- Then there exists 
A: / —7- T*M along 7 and I G N satisfying N[ = A r / + i such that for every i = 0, . . . , / there exists a 
family of vector fields 

55( 7 (*),«) = {Zi(7(t)^),---,^(7(*)^)} C V£\l(t)) (9) 

fulfilling that 

(i) the sequence of constraint submanifolds N{ obtained from the presymplectic constraint algo- 
rithm is given by 

N i = {(p,u)€N i - 1 \(J3,Z j {x,u))=0,j = l,...,n i h P G T*M, (10) 
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fori = l,... ,1; 
(ii) and (A, u) G N\. 

Proof. Since (7, u) is optimal, Theoremll8lcan be applied and the presymplectic constraint algorithm 
can be used. For i = 0, Nq = {(/3, u) | (/3, X c {x)) = 0, c = 1, . . . , k}. For control-affine systems the 
assumption of abnormality assures that Remark [9] is true provided that is in the interior of the 
control set, i.e. 

k 

cone(conv(^u c X c ( 7 (t)) | u E U)) C ^( 7 (*)). 

c=l 

Thus the primary constraint submanifold is defined as in (|10|) . Hence 

%> ( 7 (t),u) = {X 1 ( 1 (t)),...,X k ( 1 (t))}. 

Inductively, assume the result holds for i — 1 and prove it for i. If (\,u) € Ni-i, then 

(x,Zj(x,u)} = o, j = 1, ...,m-i, 

where Zj(~{{t),u) S 3^i-i{^{t), u) C ^ 2 (7(t)). In order to obtain the following constraint submani- 
fold we compute 

— (X,Z j (x,u)) = (A, [£ ,Zj](x, u)) =0. 

In \15\ Section 4] it is proved that [£oj^'] is a variation of order % + 1. Thus it is true that the 
abnormal lift lies in a constraint submanifold iVj defined as in (jlOp . ■ 

Observe that for driftless control systems this result is proved straightforward because the control 
system is control-linear. Then, 

[i ,z 3 ] = jV 5 , T2 )(o) = f ('i-^ «i>, z <i>r«i-f ) MOXo), 

where the juxtaposition of maps denotes composition. Thus the vector field [£o 5 Zj] is obtained as a 
high order elementary perturbation vector at 7(t) of order 2. 

As in PMP, the above proposition does not guarantee the uniqueness of the momentum, there 
might be more than one lift to the cotangent bundle of the optimal curve satisfying the necessary 
conditions. 

If the controls do not appear explicitly in the constraints defining the submanifolds in ()10p , then 
the supporting hyperplane contains subspaces generated by the family of vectors ([9]) in the high 
order tangent perturbation cone. These conditions impose restrictions on the momentum. If the 
controls appear in the constraints, then we might be able to determine the vector field whose integral 
curves are the biextremals of the OCP. 

Remember that to solve uniquely Hamilton's equations "only" the controls and the initial condi- 
tion for the momentum must be determined. After applying the presymplectic constraint algorithm 
it could happen that the initial condition for the momentum is not completely determined. If we 
prefer to restrict more the candidates to be optimal, then it must be imposed that the momentum 
defines a supporting hyperplane to all the infinitesimal variations and not only to the ones appearing 
in (fTOj). 

Remark 20. The constructions in Definitions [6] and [8] have been successfully related with the 
presymplectic constraint algorithm. However, for each control system, only some infinitesimal vari- 
ations appear in the constraint algorithm as the inclusion in Q indicates. More details are given 
in the following section. 
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3.3 Example: Affine connection control systems 



The affine connection control systems are a class of control mechanical systems widely-studied in 
the literature [7j- If Q is the configuration manifold and V is an affine connection on Q, the control 
system on TQ is the following control-affine system 



7(t) = (Z + J> c Y/)( 7 (t)), 



c=l 

where 7: I — > TQ, Z is the geodesic spray associated with V and Y% is the vertical lift of Y c . 

Let £0 be the reference trajectory with control uq. The Campbell-Baker-Hausdorff formula [20 
is useful to describe specifically the sets 3fj whose existence has been proved in Theorem [T9j 

%(l(t),u) = 

j 1 )( 7 (t))) (0) I 6 = Z + ]T ulY? + yA 

k=l )i=l,...,k. 

= {y/(7(t)),...,n l/ (7(0)}- 

Moreover, it can be also proved that 



J 2 



***S <i>M>%K-i/;)) (o) 1 c ±t = z + J2 «sn v ± n v 

fc=l )i=l,...,k. 

= {[&,^ v ](7(*)),...,Ko,l^](7(*))}- 

Note that if (A,u) E iVo, then A annihilates ^0 and 

fe 

(a, [£ ,if ]) = (a, [z,y/] -X)^ v («8)n v > = [^,y, v ]) = 0. 

c=l 

Thus the controls are not determined in these first two primary constraint submanifolds. Only 
the momenta has been restricted because the high order tangent perturbation cone contains the 
subspaces generated by ^0(7(4), and ^0(7(4), u). 

Note that 

j 1 (($f-^i° s )(7(*))) (0)= -*f( 7 (t)), 

c 

^ = 2 + ^^/-^, 
fc=i 

(($i° s $^i-^i° s )(7(*))) (0)= -[£o,*f Kt(*)), 

c 



k=l 



4 Conclusions and future work 

To sum up, HOMP provides extra conditions for optimality related with the existence of a supporting 
hyperplane. Computationally speaking, it is difficult to construct explicitly all the infinitesimal 
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variations. In the same way, it was difficult to deal with the condition of maximization of the 
Hamiltonian over the controls and that is why it is usually replaced by the necessary condition 
dH/du = 0. From this weak first order necessary condition, the presymplectic constraint algorithm 
gives an idea about how to replace the existence of the supporting hyperplane in HOMP by the 
conditions in Theorem 1 191 These last ones provide less information, but they establish a connection 
between the weak high order maximum principle and the application of the presymplectic constraint 
algorithm to optimal control theory. The conditions obtained by this algorithm are more suitable 
to work with than to try to write down all the (£, T2)-infinitesimal variations as pointed out in the 
following section. 

This paper sets up the foundations to characterize abnormality by means of geometric high order 
necessary conditions for optimality. We have weakened Krener's high order maximum principle to 
Theorem 1181 which in turn has been weakened to Theorem 1191 to obtain easier necessary conditions 
for optimality to compute. Next step is to describe when these weaker necessary conditions can 
also satisfy the above-mentioned stronger necessary conditions for optimality. In particular, how 
it can be detected by means of the presymplectic algorithm if the momentum, apart from defining 
a supporting hyperplane to some (£, T2)-infinitesimal variations, also determines the supporting 
hyperplane in Theorems [15] and fl8l As mentioned earlier, this supporting hyperplane must be 
indeed a separating hyperplane of the cone and the decreasing direction of the cost function in order 
not to contradict the optimality condition. Thus, it is also necessary to study how to detect when 
the supporting hyperplane is the separating hyperplane used in the proof of Krener's Maximum 
Principle. 

In this regard, it could be useful to be able to define some vector-valued quadratic forms gener- 
alizing the ones considered in [7] to study second order conditions for controllability. It should be 
analyzed how those quadratic forms take part in the presymplectic constraint algorithm. 

In [2] some notions of controllability for control-affine systems have been characterized for first 
time in the literature in a coordinate-free way. Thus a future research line consists of describing 
necessary conditions for optimality using the notion of affine bundles and the jet bundle theory. 
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